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Abstract 

A finite memory is introduced in the score dynamics of Minority Games. As ex- 
pected, this removes the dependence of the stationary state on the initial conditions. 
However, it also causes an unexpected increase of fluctuations in grand-canonical 
models for very large times. Current analytical methods are inadequate to solve this 
simple and natural extension. 
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1 Introduction 

Remarkable new phenomenology arises when agents are granted the possibility 
of not participating in a game [1,2]. In the context of the Minority Game 
(MG) [3], this extension - which takes the name of Grand Canonical MG 
(GCMG) - has been introduced independently by several authors [4,5,6]. The 
MG captures some aspects of financial market dynamics, namely the interplay 
between exploitable predictability, price fluctuation and trader behaviour (we 
refer the interested reader to [2,7,8,9] for more details). Furthermore, GCMGs 
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reproduce some of the main stylized facts of financial market phenomenology, 
such as large price changes and volatility clustering [2.5.10,11]. Remarkably, 
these features emerge close to a phase transition, thus suggesting that financial 
markets operate in the vicinity of a critical point [2,9]. 

For physicists, this is almost intuitive. Nevertheless, it is hard to convince 
economists that it is actually true. The MG is able to propose a coherent ac- 
count of why financial markets are at criticality, based on market (in)efficiency 
(or predictability) [2,9]. The idea of explaining anomalous fluctuations as a 
critical phenomenon is not new. Other models, notably those based on two- 
dimensional percolation [12], also relate stylized facts with criticality. There 
is however little reason to consider the market as bi-dimensional (although 
the trading floors are), or to believe it should spontaneously reach the critical 
percolation probability. The fact that all kinds of flnancial markets gener- 
ate power-law-distributed price changes imphes that a reasonable model of a 
flnancial market should not need the flne-tuning of a parameter. 

An annoying feature of the GCMG is that, close to the phase transition, 
its dynamics displays a peculiar dependence on initial conditions: anomalous 
fluctuations only materialize in some realizations of the dynamics, whereas 
others exhibit plain Gaussian price fluctuations [2]. The introduction of a 
flnite memory in the learning dynamics of agents, such that the impact that 
events occurred far in the past have on the agents' choices in the present 
vanishes with the time lag, is the natural remedy to this inconvenient. This 
modification was introduced in [13] for a model in which agents play the MG 
strategically. Here we focus on the standard MG, where agents adopt a naive 
price-taking behavior [9]. 

We shall first show that indeed a finite memory eliminates the dependence 
on initial conditions. A direct extrapolation of theoretical results [13] suggests 
that a finite memory leads to an increase of fiuctuations. This is confirmed 
by numerical simulations. Then we shall see that, however, memory brings 
about new non-trivial effects in the GCMG. In particular, it causes a build- 
up of fluctuations in the stationary state that sets in after very large times. 
Our discussion will be mainly informal and we shall give only the minimal 
technical details. We will refer to original papers for the detailed deflnition of 
the models. 



2 Finite memory score in the standard MG 

In few words, the MG models a system of N interacting agents who should 
repeatedly take a binary decision, such as buy/sell. Each agent aims at taking 
the minority decision. This captures the fact that it is generally convenient to 
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buy when the majority sells and vice- versa. Agents resort to trading strategies 
to process market information. The latter takes one of P = aN possible 
values. The performance of each strategy is monitored by a score function. 
The dynamics of the score of strategy s has the form 

U,,s{t+l)^U,,s{t)-altfA{t) (1) 

where a^^*^ = ±1 is the action prescribed by strategy s when the information 
takes the value and A{t) is the sum of all actions (±1) of agents. At 
each time step, agents adopt the strategy with the highest score. The last 
term in (1) is the payoff of agent i for using strategy s at time t. As the 
particular form of the dynamics is not at stake in what follows, we refer to [9] 
for more details. We just remind that the key observables are the magnitude 
of fluctuations = {A^) and the information content H = (1/-P) J2fi{A\fi)'^ , 
which details how the outcome A(t) is correlated with the information 
[9,14,15]. We also remind that the value = P/ac, with ac = 0.3374..., 
separates an asymmetric, information rich phase with H > (for N < P/ac) 
from a symmetric phase with H — {N > P/ac). In the latter, the stationary 
state depends on the asymmetry 

Uo = U,,i{0)-U,,2{0) 

of the initial conditions (we focus on the MG with two strategies per agent). 
This dependence is due to the fact that, under (1), all market fluctuations 
since time t — are remembered and contribute with the same weight to 
Ui^s{t)-i irrespective of how far in the past they took place. 

This suggests to generalize (1) to 

U,,s{t + !) = (!- X/P)UUt) - (2) 

with A > a constrant. Fig. 1 shows that a time dependent cr^ = {A^)t ^ 
converges, for long times, to a value which is independent of initial conditions 
Uq. This implies that the initial asymmetry Uq has no influence on the sta- 
tionary state. This is conflrmed by Fig. 2, where we plot cr^/A" as a function 
of q; = l/us for different Uq and A. For a flxed a and for a given realization of 
the game, cr^ and H are increasing functions of A, although in the symmetric 
phase (a < Oc = 0.3374. . .) o"^ varies very slowly with A (see Fig. 3). While 
only small values of A make physical sense, for completeness the same figure 
reports also the queer effects of very large A. From (2), A = P cancels the 
contribution of Uiit) in Uiit + 1); larger A implies that this contribution is of 
opposite sign to the usual MG. 

^ Here (. . .)t stands for an average over a long but finite time interval around t. 
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Fig. 1. The same realization of the standard minority game with unbiased initial 
strategy scores and A = (circles), biased initial scores and A = (squares), biased 
initial scores and A = 0.1 (triangles). 
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Fig. 2. Average volatility a'^/N = (A^) /N versus a = P/N of the standard MG with 
unbiased initial scores and A = (circles), A = 0.1 (squares), A = 0.2 (diamonds), 
with biased initial scores and A = 0.2 (triangles). 

3 Finite memory in the Grand Canonical MG 

Let us focus now on the simplest GCMG [2], where the agents {speculators) 
possess a single strategy each and may abstain from playing if the game is 
not profitable enough. A measure of profitability is given by a parameter e, 
which measures the gains from investing outside of the market. Again, we refer 
to the original paper [2] for a detailed account. The important new feature 
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Fig. 3. a"^ /N (black lines) and H/N (red lines) for a realization of the standard 
Minority Game with increasing A 

of this model is that the number of participants is not fixed a priori, but is 
dynamically determined by market gains. The model, which includes a number 
Np of producers who trade no matter what, according to a given strategy, can 
be solved exactly in the limit of infinitely many speculators Ns ^ oo (with 
a = P/Ng = l/ris and Hp = Np/P finite) via a static replica calculation 
(this solution can be also recovered with the dynamical generating functional 
technique [16]). This allows for a systematic understanding of the model's 
properties. It turns out that a phase transition occurs for e = Oatns = l/Q;> 
rig. The transition is discontinuous across the e = line, where the number of 
active agents jumps abruptly. Stylized facts are observed, for e > 0, close to 
the point e = 0, ~ n*{P) > in finite systems, ^ and the size of the critical 
region can also be characterized. More precisely, we observe the occurrence of 
power-law distribution of returns A{t) and volatility clustering [7], or long- 
time correlations^ (|A(t)||A(t + r)|) oc t^"'. These findings are summarized 
in Fig. 4. First we see that fat tails or volatility clustering both emerge close 
to the phase transition Us ~ n*{P) and e ~ 0. Then, these two features do not 
appear in all runs. Some runs, even in the critical region, show plain Gaussian 
returns, sometimes with long range correlations and sometimes without. In the 
real world, this would imply that some markets show fat-tailed price changes, 
and some others not, which is at odds with the observed universality. 

In the GCMG, this issue signals a non-ergodic behavior and is related to the 
dependence on initial conditions. Both effects arise because of the presence of 
infinite memory in the strategy scores dynamics. This suggests to introduce 



^ n*(P) increases with P [2]. 

^ Note that other functions for describing the long-range correlation have been 
proposed [7,17] 
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Fig. 4. From top to bottom: fraction of the realizations of a grand canonical MG 
that has power-law tailed distribution of A, power-law autocorrelation function 
+ t)|) oc t~'^ (volatility clustering), and exponent 7 when volatility clus- 
tering is present {PNg = 16000, Up = 1, e = 0.01, 10'' iterations, average over 50 
realizations). 



a finite memory A > in the dynamics ^ , as done in the previous section for 
the standard MG (see (1) and (2)). We remark that, technically, finite score 
memory can also be implemented by fixing a time window T such that only the 
T most recent scores are kept by the agents, as in [5,18] ^ . The two procedures 
are equivalent for T ~ P/A. 



The dynamics of the GCMG with finite memory is surprising. At first, fluctua- 
tions are reduced and are Gaussian. Many iterations are needed before stylized 
facts emerge again. Remarkably, the typical time for the emergence of anoma- 
lous fluctuations is much larger than characteristic times, which are of order 
P/X. When one moves deeper into the crowded market region Ng/P ^ n^, 
one sees even stronger effects, as shown in Fig. 6. Still, one has to wait a 
quite long time before wild fluctuations set in. But now large price fluctu- 
ations are proportional to the number of speculators {A{t) oc A^^) and they 
appear associated to a particular information pattern fi. The sample of Fig. 
6 shows that the value of fi for which A{t) oc Ns may even change in the 
course of time. What is striking is that a modiflcation like memory, which 
naively should make the dynamics smoother by introducing a flnite cutoff in 
time dependencies, actually provokes the boost of wild fluctuations. The fact 
that this effects sets in for times much longer than the memory decay strongly 



^ A second solution may be to allow for the evolution of agent's strategies. In that 
case, as observed in [13], an infinite memory would make no sense. 
^ Such games with binary payoffs [3] can be written as a matrix; predicting large 
price changes amounts to studying its eigenvalues [19]. 
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Fig. 5. The same game with infinite memory score keeping (red) and finite (black). 
. PNs = 16000, Hs = 20, Up = I, eps = 0.01 



P=32, Ns=50'P, eps=0, lambda=0.1 init.Gond.= 
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Fig. 6. The time series of A{t) at fixed /z(t) = (red), 11 (green) and 26 (blue) in 
a run of the GCMG with P = 32, Ns = 1600, e = 0.01 and A = 0.1. 

suggests that its origin lies in collective fluctuation phenomena. Finally, as for 
the plain MG, a finite memory A > eliminates all dependences on initial 
conditions and non-ergodicity effects. 



4 Conclusions 



In short, we have shown that finite score memory suppresses non-ergodic be- 
havior and dependence on initial conditions in MGs. At the same time, it 
brings about new spectacular fluctuation phenomena in the GCMG. Inter- 
estingly, all the analytical tools used so far for the study of MG fail when 
A > 0. On one side, as soon as A > the stationary state can no longer be 
related to the minimum of a global function, in contrast with the A = case 



7 



[2,14,15,20]. This seems to rule out replica approaches. On the other, a fi- 
nite memory destroys the frozen component of the dynamical variables which 
allows one to extract information from the generating functional approach 
[21,22]. This makes finite memory MG a quite challenging problem. 
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